Nevada County
PA-RAG: RAG Alignment via Multi-Perspective Preference Optimization
Wu, Jiayi, Cai, Hengyi, Yan, Lingyong, Sun, Hao, Li, Xiang, Wang, Shuaiqiang, Yin, Dawei, Gao, Ming
The emergence of Retrieval-augmented generation (RAG) has alleviated the issues of outdated and hallucinatory content in the generation of large language models (LLMs), yet it still reveals numerous limitations. When a general-purpose LLM serves as the RAG generator, it often suffers from inadequate response informativeness, response robustness, and citation quality. Past approaches to tackle these limitations, either by incorporating additional steps beyond generating responses or optimizing the generator through supervised fine-tuning (SFT), still failed to align with the RAG requirement thoroughly. Consequently, optimizing the RAG generator from multiple preference perspectives while maintaining its end-to-end LLM form remains a challenge. To bridge this gap, we propose Multiple Perspective Preference Alignment for Retrieval-Augmented Generation (PA-RAG), a method for optimizing the generator of RAG systems to align with RAG requirements comprehensively. Specifically, we construct high-quality instruction fine-tuning data and multi-perspective preference data by sampling varied quality responses from the generator across different prompt documents quality scenarios. Subsequently, we optimize the generator using SFT and Direct Preference Optimization (DPO). Extensive experiments conducted on four question-answer datasets across three LLMs demonstrate that PA-RAG can significantly enhance the performance of RAG generators. Our code and datasets are available at https://github.com/wujwyi/PA-RAG.
- Europe > Austria > Vienna (0.14)
- North America > United States > Washington > King County > Seattle (0.14)
- Asia > Singapore (0.04)
- (30 more...)
- Personal (1.00)
- Research Report (0.63)
- Media (1.00)
- Leisure & Entertainment > Sports > Olympic Games (1.00)
- Leisure & Entertainment > Sports > Motorsports > Formula One (1.00)
- (5 more...)
Online Long-run Constrained Optimization
In this paper, a novel Follow-the-Perturbed-Leader type algorithm is proposed and analyzed for solving general long-term constrained optimization problems in online manner, where the objective and constraints are not necessarily convex. In each period, random linear perturbation and strongly concave perturbation are incorporated in primal and dual directions, respectively, to the offline oracle, and a global minimax point is searched as solution. Based on two particular definitions of expected static cumulative regret, we derive the first sublinear $O(T^{8/9})$ regret complexity for this class of problems. The proposed algorithm is applied to tackle a long-term (risk) constrained river pollutant source identification problem, demonstrating the validity of the theoretical results and exhibiting superior performance compared to existing method.
- Asia > China > Hong Kong (0.04)
- North America > United States > Nevada (0.04)
- North America > United States > District of Columbia > Washington (0.04)
- (2 more...)
What wet winter? California prepares for peak wildfire season
As California faces its first major heat wave of the summer this Fourth of July weekend, state officials are urging residents to not become complacent about the threat of wildfires this year. Standing beneath the blistering sun at the Grass Valley Air Attack Base in Nevada County, California Department of Forestry and Fire Protection chief Joe Tyler outlined the state's plans to battle blazes this year with new tools and technology, as well as increased vegetation management efforts. He cautioned that while the wet start to 2023 may have delayed the start of fire season, it has not deterred it. "The abundant rain has produced tall grass and other vegetation that's dried out already and is ready to burn," Tyler said. Additionally, portions of the state are expected to soar into the triple digits this weekend, including up to 110 degrees in the Sacramento Valley.
- North America > United States > Nevada (0.25)
- North America > United States > California > Nevada County (0.25)
- North America > United States > California > Riverside County (0.05)
- North America > United States > California > Sacramento County > Sacramento (0.46)
- North America > United States > California > Butte County > Oroville (0.14)
- North America > United States > California > Los Angeles County > Los Angeles (0.14)
- (29 more...)
- Press Release (1.00)
- Personal > Honors (1.00)
- Instructional Material > Course Syllabus & Notes (0.67)
Is Artificial Intelligence The Future of Avalanche Forecasting? - SnowBrains
Considered by some observers as more of an art than a science, avalanche forecasting involves a unique combination of human observation, analysis, and interpretation. Even the best forecasters only reach about 75% accuracy in their predictions. After all, they are human too and susceptible to bias and imperfection just like the rest of us. One of the biggest challenges in creating an accurate forecast lies in the fact that avalanche danger cannot be precisely measured and is therefore a matter of expert assessment (opinion). That was until last season when the Swiss Institute for Snow and Avalanche Research Group (SLF), a part of the National Swiss Federal Institute for Forest, Snow, and Landscape Research successfully tested a first-of-its-kind, artificial intelligence computer program to assist in its avalanche forecasts.
- North America > United States > Montana > Gallatin County > Bozeman (0.07)
- North America > United States > Washington > King County > Seattle (0.05)
- North America > United States > Utah > Salt Lake County > Salt Lake City (0.05)
- (8 more...)
The Secret Auction that Set Off the Race for AI Supremacy
By the time he stepped onto a bus in downtown Toronto for the first leg of a trip to Lake Tahoe in December 2012, Geoff Hinton hadn't taken a seat for seven years. "I last sat down in 2005," he often said, "and it was a mistake." He first injured his back as a teenager, while lifting a space heater for his mother. As he reached his late fifties, he couldn't sit down without risking a slipped disk, and if it slipped the pain could put him in bed for weeks. So he stopped sitting down.
- North America > Canada > Ontario > Toronto (0.39)
- North America > United States > Nevada (0.07)
- North America > United States > New York (0.05)
- (2 more...)
The Secret Auction That Set Off the Race for AI Supremacy
By the time he stepped onto a bus in downtown Toronto for the first leg of a trip to Lake Tahoe in December 2012, Geoff Hinton hadn't taken a seat for seven years. "I last sat down in 2005," he often said, "and it was a mistake." He first injured his back as a teenager, while lifting a space heater for his mother. As he reached his late fifties, he couldn't sit down without risking a slipped disk, and if it slipped the pain could put him in bed for weeks. So he stopped sitting down.
- North America > Canada > Ontario > Toronto (0.39)
- North America > United States > Nevada (0.07)
- North America > United States > New York (0.05)
- (2 more...)
Online Non-convex Learning for River Pollution Source Identification
Huang, Wenjie, Jiang, Jing, Liu, Xiao
In this paper, novel gradient based online learning algorithms are developed to investigate an important environmental application: real-time river pollution source identification, which aims at estimating the released mass, the location and the released time of a river pollution source based on downstream sensor data monitoring the pollution concentration. The problem can be formulated as a non-convex loss minimization problem in statistical learning, and our online algorithms have vectorized and adaptive step-sizes to ensure high estimation accuracy on dimensions having different magnitudes. In order to avoid gradient-based method sticking into the saddle points of non-convex loss, the "escaping from saddle points" module and multi-start version of algorithms are derived to further improve the estimation accuracy by searching for the global minimimals of the loss functions. It can be shown theoretically and experimentally $O(N)$ local regret of the algorithms, and the high probability cumulative regret bound $O(N)$ under particular error bound condition on loss functions. A real-life river pollution source identification example shows superior performance of our algorithms than the existing methods in terms of estimating accuracy. The managerial insights for decision maker to use the algorithm in reality are also provided.
- Asia > China > Shanghai > Shanghai (0.04)
- North America > United States > California > Nevada County > Truckee (0.04)
- Asia > China > Guangdong Province > Shenzhen (0.04)
- (8 more...)
Precipitation Record Set in Northeast Nevada After Storm
A winter storm warning expired in the Lake Tahoe region Friday afternoon. The weather service said 11 inches (28 centimeters) of snow was recorded Thursday night and early Friday at the Northstar ski resort near Truckee, California and about 10 inches (25 centimeters) at Mt. Rose southwest of Reno. Up to 7 inches (18 centimeters) was reported at Heavenly in South Lake Tahoe, California.
- North America > United States > Nevada (0.40)
- North America > United States > California > Nevada County > Truckee (0.39)
- North America > United States > California > El Dorado County > South Lake Tahoe (0.39)